BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on EVT-TOTAL events by Approx. Span matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[EVT-TOTAL]==       1529 (  898)     1259 (  898)    58.73    71.33    64.42
[JULIELab ]       ==[EVT-TOTAL]==       1529 (  879)     1374 (  879)    57.49    63.97    60.56
[VIBGhent ]       ==[EVT-TOTAL]==       1529 (  776)     1154 (  776)    50.75    67.24    57.85
[UT+DBCLS ]       ==[EVT-TOTAL]==       1529 (  739)     1072 (  739)    48.33    68.94    56.82
[ConcordU ]       ==[EVT-TOTAL]==       1529 (  659)      897 (  659)    43.10    73.47    54.33
[ UTokyo  ]       ==[EVT-TOTAL]==       1529 (  660)      985 (  660)    43.17    67.01    52.51
[ASU+HU+BU]       ==[EVT-TOTAL]==       1529 (  602)      849 (  602)    39.37    70.91    50.63
[  UNSW   ]       ==[EVT-TOTAL]==       1529 (  624)      995 (  624)    40.81    62.71    49.45
[ UNIMAN  ]       ==[EVT-TOTAL]==       1529 (  635)     1044 (  635)    41.53    60.82    49.36
[ UZurich ]       ==[EVT-TOTAL]==       1529 (  638)     1084 (  638)    41.73    58.86    48.83
[  SCAI   ]       ==[EVT-TOTAL]==       1529 (  617)     1015 (  617)    40.35    60.79    48.51
[ UAveiro ]       ==[EVT-TOTAL]==       1529 (  562)      857 (  562)    36.76    65.58    47.11
[ Team 24 ]       ==[EVT-TOTAL]==       1529 (  567)      977 (  567)    37.08    58.03    45.25
[   Cam   ]       ==[EVT-TOTAL]==       1529 (  507)      744 (  507)    33.16    68.15    44.61
[UAntwerp ]       ==[EVT-TOTAL]==       1529 (  533)      888 (  533)    34.86    60.02    44.10
[CNBMadrid]       ==[EVT-TOTAL]==       1529 (  709)     1835 (  709)    46.37    38.64    42.15
[ USzeged ]       ==[EVT-TOTAL]==       1529 (  616)     1473 (  616)    40.29    41.82    41.04
[  NICTA  ]       ==[EVT-TOTAL]==       1529 (  426)      676 (  426)    27.86    63.02    38.64
[CCP-BTMG ]       ==[EVT-TOTAL]==       1529 (  377)      490 (  377)    24.66    76.94    37.35
[CIPS-ASU ]       ==[EVT-TOTAL]==       1529 (  529)     1405 (  529)    34.60    37.65    36.06
[  PIKB   ]       ==[EVT-TOTAL]==       1529 (  340)      479 (  340)    22.24    70.98    33.86
[  UMich  ]       ==[EVT-TOTAL]==       1529 (  733)     3278 (  733)    47.94    22.36    30.50
[ KoreaU  ]       ==[EVT-TOTAL]==       1529 (  288)      456 (  288)    18.84    63.16    29.02
[ Team 09 ]       ==[EVT-TOTAL]==       1529 (  332)      848 (  332)    21.71    39.15    27.93

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[EVT-TOTAL]==       1535 (  718)     1072 (  718)    46.78    66.98    55.08
[ASU+HU+BU]       ==[EVT-TOTAL]==       1535 (  544)      849 (  544)    35.44    64.08    45.64
[ Team 24 ]       ==[EVT-TOTAL]==       1535 (  550)     1021 (  550)    35.83    53.87    43.04
[UAntwerp ]       ==[EVT-TOTAL]==       1535 (  508)      888 (  508)    33.09    57.21    41.93
[CNBMadrid]       ==[EVT-TOTAL]==       1535 (  638)     1835 (  638)    41.56    34.77    37.86
[CCP-BTMG ]       ==[EVT-TOTAL]==       1535 (  373)      490 (  373)    24.30    76.12    36.84

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------